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ABSTRACT 


A linear programming model of U.S. Army Combat Develop- 
ment Experimentation Command is proposed. It provides a 
planning tool which allows utility, expressed as relative 
worth, to be maximized subject to resource constraints. 
Relative value of an experiment is defined to be the con- 
tribution which the experiment makes toward USACDEC's general 
experimental objectives. It is derived by determining all 
the tasks required to accomplish the command's general 
experimental objectives, evaluating the importance of each 
task in the accomplishment of the objectives, and determining 
how many of the tasks are accomplished by an experiment. 

This procedure leads to a number which represents the 
decision makers feelings about the importance of the experi- 
ment. The numbers are used as coefficients of a linear ob- 
jective function which is maximized by a zero-one integer 
program. The result is the selection from a set of ex- 
periments those which maximize relative value subject to 


resource constraints. 
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J. — INTRODUCTION 


A manager must allocate available scarce resources to 
his subordinate activities in such a way that the output of 
the organization is maximized. He may be able to allocate 
the resources so that the output of a single subordinate 
activity is maximized but will usually find that the allo- 
cation is not best for the organization as a whole. His 
decision is, then, how to allocate available resources so 
that the organization as a whole will benefit most. 

Maximizing output subject to resource constraints has 
been the subject of much research and exposition. An ap- 
proach to the problem, developed by DOE formene 5. 
Air Force, is the technique of linear programming. Variations 
of this approach have been used to develop models to help in 
the problem of capital budgeting. These models seek to 
choose from alternative investment possibilities the best 
combination possible within a given budget constraint. 

Hillier* proposes a model for selection of optimal in- 


vestment proposals from a set of proposals by maximizing 


1. Dantzig, G.B., Linear Programming and Extensions, 
Princeton, N.J.: Princeton University Press, 1963. 
22 Hillier, Frederick S.," A BaSic approach to the Evalua— 


tion Of Risky Interrelated Investments," in R.F. Byrne, et 
al., Studies in Budgeting, New York, N.Y.: American Elsevier 


ши а ոց Company, Inc., 1971. 





expected utility. Both linear programming -mom аше те 
and-bound algorithm are offered as solution techniques. 

Naslund? uses chance constrained programming (a linear 
programming technique with probabilistic constraints) to 
solve the capital budgeting problem and Byrne” uses a similar 
technique called two-staged linear programming under 
uncertainty. 

Hartman and Moglewer? use an approach based upon the 
theory of games to develop a model for allocating resources 
to research projects. | 

The purpose of this paper is to address the problem of 
SaO cating SCarce resources for experimentation Inssuppore 
of Army Combat Development. In particular, a model will be 
offered by which resources may be efficiently allocated to 
carry out general experimental objectives. The organization 
and functions of the U.S. Army Combat Development Experimen- 
tation Command (CDEC) will be presented as a framework for 


development of the model. The underlying assumptions and 


3. Naslund, Bertil, "A model of Capital budgeting Under Risk," 
Б.Е. Byrne, et al. , Studies in Budgeting, New York, N.Y.: 
American Elsevier Publishing Company, Inc., 1971. 


4. Byrne, R. F., "A Chance Constrained Approach to Capital 
Budgeting with Portfolio Type Payback and Liquidity Constraints 
ama Horizon Posture Controls," in R.F. Byrne, et al., Studies 
in Budgeting, New York, N.Y.: American Elsevier Publishing 
company, Լո 1971: 


~ " пакепап, Frederick and 5. Мод: емек. А'1ова топ ов кал 
source to Research Proposals," Management Science, 14:1 
(September, 1967) 





ideas of the model will be discussed in detail and a hy- 
pothetical problem and its solution presented. 

Two definitions are necessary at this point. The first 
is combat development which is 

...the formulation of new or improved army doctrine, 
organizations, and material objectives and the early 
integration of these products into the Army. 

The other is field experimentation which is 

...а series of field trials, under controlled con- 
ditions, employing appropriately trained personnel and 
selected types of equipment in functionally designed 
operational mixes, the actions and interactions of 

which are objectively instrumented, measured, and re- 

corded for scientific analysis. 

Combat development is concerned with new ideas and con- 
cepts which may exist only as mathematical formulas or models. 
At a lower level of abstraction is field experimentation, 
used to test hardware in order to derive numbers which can 
be used in combat simulations and war games. 

А. CDEC: EXTERNAL 

Figure l gives the position of CDEC within the Department 
of Army/Combat Development Command hierarchy. CDC directs 
Army combat development activities under the general guidance 
of the Department of Army and is the major Army command re- 
sponsible for combat development. 

լ աթ CDEC: INTERNAL 


Figure 2 gives the organization of CDEC. There are seven 


important subelements within the organization, and all combine 


6. Experimentation Manual, USACDCEC, July 1971. pp. 1-1, 
1-2. "ESTI 
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efforts to accomplish CDEC's mission of field experimentation. 
Keyed to Figure 2, they are, in order, (and greatly simpli- 
fied): 
J. Бетеп ртс Support Laboratory: 
civilian contractor; provides CDEC with technical 
advice in experimental design and engineer support. 
շա Administration and воа сев: 
performs usual ađministration and logistic function. 
3. DCS, Plans and Programs: 
responsible for long range experimentation; planning 
initial contact on all proposed experiments; all actions 
through completion of Project Analysis. 
4. DCS, Experimentation: 
responsible for planning, execution, and reporting 
of experiments after Project Analysis; determines total 
experimentation requirements. 
5. DCS, Instrumentation: 


provides instrumentation support to field experimen-- 


бз DCS, Comptroller: 
performs the usual budgetary function. 
7. Experimentation Brigade: 
provides command and control for player and other 
Support personnel. 
The interaction of these elements may be depicted 
graphically as in Figure 3 and Figure 4, which trace through 
the organization a CDC concept which is to be tested. These 


charts also describe the experimental cycle which consists 
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of the steps necessary to plan, conduct, and report a field 
experiment. The primary concern here will be with the initial 
Planning, in particular Ene Ёсо ёс 211: ске 

Action after the Project Analysis consists of detailed 
planning, execution, and reporting the experiment. The fact 
that these actions are not discussed further here does not 
mean that they are not considered to be important. To the 
contrary, they are the essence of the operation. Experimen- 
tation can proceed without a well defined plan, but not with- 
Еш good execution. An experiment which 1s well planned апа 
well executed will provide a much better end result. It is 


the aim of this paper to aid in this planning. 


со PROJECT ANALYSIS 

The purpose of the project analysis is to develop a 
concept for experimentation which will best satisfy ex- 
perimental objectives within available resource and time 
constraints. Within this concept, a design must be developed 
that will accomplish experimental objectives. 

A project analysis may generally be described as follows: 
experimental objectives contained in the CDC Experimentation 
Schedule (or from other sources) are analyzed to determine 
Specific tasks. These general objectives are then defined 
in terms of actions which must be taken and measurements 
which must be made. The analysis is done by a project 
analysis task group which has in it representatives from the 
seven —supelements Of “CDEC. The project group =рес виса К. 


considers such things as constraints on location, resources, 


Л 





ЕКЕН 


СОХСЕРТ 


НО 
CDEC 








PROJECT ANALYSIS 
GROUP 


PROJECT 
ANALYSIS 


Figure 3 


12 





PROJECT 
ANALYSIS 










‚ (APPROVAL) 





DCS 
EXPERIMENTATION 


EXECUTION 
OF 
EXPERIMENT 


FINAL REPORT 


Figure 4 





and time, scenario, data requirements, instrumentation re- 
quirements, scheduling, budget estimates, and experimental 
design. Particularily interesting Ys the места пенею нам 
the scheduling of resources by the Project Analysis Group. 
This can become an extremely difficult task in which a pro- 
posed experiment (or set of experiments) must be scheduled 
concurrently with other experiments, all of which compete 


for the same scarce resources. 


р. ALLOCATION PROBLEM 

Stated simply and briefly, CDEC's allocation problem is 
that there are normally not enough men and equipment to do 
all the experiments that CDEC wants to do. Since there is 
not enough to go around, how should that which is available 
be allocated? Should scarce resources be equally divided 
among all competing experiments or should more be given to 
the more important experiments? In what sense is one ex- 
periment more important than another? After an allocation 
has been proposed how can one be sure that it is the best? 
Subsequent sections will attempt to provide an approach -to 


answering these questions. 


8. The preceeding discussion was based on information 
contained in Experimentation Manual, USACDCEC, July 1971 
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II. RECATIVE VALUE 


This section will attempt to provide an answer to the 
question: In what sense can one experiment be more important 
than another experiment? To answer the question, the concept 
of relative value (of an experiment) will be introduced, 
defined, and described in detail. A method by which the 
relative value of an experiment can be derived will be 
proposed. This method will allow the relative value of an 
experiment to be expressed by a single number, providing 
сишеатев ОБ сопраклпа the importance of two different ex- 
periments. Relative value will be defined in terms of general 
experimental objectives and objective components. Quantifi- 
cation of relative value will be done by an approach called 
detailed component analysis. 

The general idea for an approach using the concept of 
relative value came from an article in Operations Research 
by Chamberlain and cia which presented a method for 
measuring the contributions of proposed unmanned missions 
toward attaining the scientific objectives of exploring 
the solar system. Major objectives are first identified, 
БЕН, "Investrgote the origin and evolution of life in the 


solar system; investigate the origin and evolution of the 


1. Chamberlain, Robert G. and Louis Kingsland, Jr., А 
Methodology to Compare Policies For Exploring the Solar 
УЕ Operations Research, 13:4 (July-August, 1970): 
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solar ано These major objectives are then defined in 
greater detail by a set of sub-objectives. An "objective 
tree" is constructed representing successive levels of detail 
until specific accomplishments (tasks) are identified. This 
process is depicted in Figure due 

The numbers above the sub-objectives in Figure 5 are 
determined by considering the relative contribution of each 
of the branches (sub-objectives) to the next higher branch. 
Major objectives are not assigned a value, so a value rela- 
tive to all the major objectives cannot be computed. It 
Ms assumed here that the major objectives cannot be compared. 
In order to compute the contribution of a proposed mission 
oa particular major objective, the tasks on the tips of the 
objective tree which will be accomplished by the mission are 
listed. For example, a mission which only searched for 
actual extraterrestrial life on Mars and Venus would accomplish 
two of the tasks at the tips of the tree. They are considered 
to be worth .20 and .70 respectively, to the accomplishment 
of the next higher branch. Together they accomplish .90 
OE the next higher branch. The next higher branch is weighted 
.70 and since it is only .90 accomplished the .70 it is 
weighted is multplied by .90. No other subtasks contribute 
so the contribution of this mission to the major goal is 


8557 (.90x. 70). 


бое ла; р, 6025 


3. Ibid, p. 597. 
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Outer planets.02 


This general approach, with certain modifications and 
extensions, will be used to evaluate experiments. The ap- 
proach will be modified so that major objectives will be 
compared and will be extended to consider experiments of 
the type performed by CDEC. 

The preceeding description hints at the idea of relative 
value to be used in this paper. Fishburn 2 that it is 
"...assumed meaningful to consider a set of real numbers ... 
to describe the relative importance of the consequences to 
the decision Pa, 

He admits that it is theoretically possible to measure 
this number but indicates that there are great practical 
difficulties caused by the requirement to measure and use 
subjective probabilities. These difficulties are caused by 
the large number of consequences which the decision maker 
must consider and by his ability to state his preferences 
honestly and without ambiguity. Other problems are the fact 
that objectives may be uncertain and preferences may change 
over time. The undesirable consequence of such an assumption 
is that an individual's stated preference may not accurately 
reflect his true feelings.” 

Although he assumes that it is possible for relative value 


to exist, he declares that any attempt to measure a unique 


4. Fishburn, Peter C. Decision and Value Theory, New York: 
МӘН ШІ леу с ое, Inc., 1964, р. 123. 





5. Ibid, pp. 84-87. 
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number is at best 00. The important idea is the 
ability to represent importance to the decision maker by a 
number and the fact that that number will probably be only 
approximate. Fishburn is also strongly against the idea that 
the magnitude of importance can be represented by the magnitude 
of a number and that a consequence or event with a number 

.80 assigned to it is twice as important as a consequence 
with .40 assigned to it. The ability of a decision maker to 
do this is questionable and schemes using subjective prob- 
abilities have been devised to get around the problem. Other 
authors feel, however, that the test of a concept should be 
whether or not it produces results. Pardee’ and Miller? 
have approached the concept in this fashion and this paper 
will approach it in the same manner. 

Miller formulated a procedure for assessing worth and 
designed an experiment to test whether or not professional 
decision makers could implement the procedure and with what 
degree of success. The experiment was performed on students 
at the Defense Weapons System Management Center at Wright- 
Patterson Air Force Base, Dayton, Ohio. ТЕ involved a set 
of decisions the students made while at the school and it 


indicated that the worth assessment procedure can be used to 


ВЕР“ трла, р. 1285. 

и Pardee, F.S., Е аа че and ла епа оно ани 
Transportation System Effectiveness, Santa Monica: The Rand 
Corporation, 1969. 


8. Miller, James В. III. Professional Decision Making, 
New York: Praeger Publishers, 1970. 


ЕЭ 





assess alternatives and can be used to make decisions as long 
as the process reflects what the decision maker wants it to 
J 
reflect. 
The method that will be followed closely here is developed 
раје, е5 а!. it recognizes the problems pointed ы a 
Fishburn, but trys to develop a model that, if understood and 


properly used, will yield results. 


A. RELATIVE VALUE OF AN EXPERIMENT: 

The relative value of an experiment will be defined in 
terms of experimental objectives and objective components. 
These two ideas are defined as: 

l. Experimental Objectives: 

The goals toward which an experiment or set of ex- 
periments are conducted. These are assumed to be known to 
CDEC decision makers and planners and may be long range or 
confined to a particular time period. They may be such | 
goals as finding information about new equipment or concepts 
and may be internally generated or directed by CDC. 

2. Objective Components: 

The sub-objectives and specific tasks which if ac- 
complished will complete all of the experimental objectives. 

It is assumed that at any point in time a set of 
experimental objectives and objective components exists and 


is known to the planners and decision makers of CDEC. That 


ОУ ТОТО S sa M 
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is, they know what must be done and all the tasks required 
to do it. The relative value of an experiment is it's contri- 


bution toward accomplishing the experimental objectives. 


В. METHODOLOGY: GENERAL: 

A number must be assigned to each experiment to represent 
its relative value. Pardee assigns value to transportation 
systems by assigning something called worth to the lowest 
level of his objective tree. These values are then carried 
up through the tree to give a value for the proposal. Here, 
the lowest tasks receive value of 0 or 1 depending on whether 
or not a proposed experiment accomplishes a task. If the 
task is accomplished it is assigned a value of 1.0; if not, 
it is assigned a value of 0.0. Before a number for the 
relative value of the experiment can be arrived at, the 
relation of all the experimental components must be stated. 
This is the process described earlier in which the contribu- 
tion of each sub-branch of a branch is evaluated relative 
to the other sub-branches in that branch. Once these numbers 
are available, computing the relative value of an experiment 


1s an easy task. 


C. DETAILED COMPONENT ANALYSIS: 

This is a process in which objective components are stated 
and contributions to higher objectives determined. Again it 
must be emphasized that it is assumed that experimental 
objectives can be decomposed by planners and decision makers 
until specific tasks are stated. These must be tasks which 


people who carry out experiments can understand and perform. 
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It is necessary to distinguish between the relative value 
of an experiment and the relative contribution of a component 
to a higher objective. The term weight will be used to 
describe the relative contribution of a component. The 
weights assigned to all the components resulting from the 
decomposition of experimental objectives will be used to 
determine the relative value of an experiment. 

1. Assignment of Weights to Components: 

The procedure for assigning weights follows the 
general idea expressed in the space exploration example 
and in particular -follows closely an algorithm given by 
Pardee.° This procedure, slightly modified to fit in the 
experimental framework is as follows: 

a. Define a set of weights for every component which 
is subdivided. Each sub-division is assigned a number. 

b. The number assigned to each component sub- 
division is interpreted as the perceived relative importance 
of each sub-division in accomplishing the component of which 
me is a part. 

c. Relative importance will Бе reflected in the 
ratios of assigned weights. 

d. Weights will be in the range 0.0 to 1.0. 

e. Weights are assigned by pairwise comparison of 


sub-divisions. 


MOES Pardee ор. cue рр. 420422. 
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2. Pairwise Comparison 

Sub-divisions are listed in order of importance and 
the number 1.0 assigned to the most important (first in the 
list). Next, the second sub-division iS compared to the 
first. If accomplishment of the second sub-division seems 
only 1/2 as important as the first, then the number .50 is 
assigned to it. Then compare the second and third sub- 
division and assign a number to the third which reflects 
it's importance relative to the second, multiply this number 
by the number assigned to the second and assign the product 
to the third sub-division. For example, if the sen sub- 
division were assessed as being 1/2 as important as the first 
and the third 1/5 as important as the second the number as- 
signed to the third would be 1/2 x 1/5= 1/10= .10. Repeat 
this procedure until the list is exhausted. Finally, sum 
all the assigned numbers and divide each assigned number by 


the sum. This will give a set of positive numbers which 


sums to 1.0 and preserves the ratios of any pair of weights. 


D. ILLUSTRATION 

The above process will now be illustrated by a hypothet- 
ical example. Assume that there are only two experimental 
objectives Ojand 07. Let 0, be a requirement to gather data 
about the optimum size of the infantry squad and let 02 
be a requirement to gather data about optimum ratio of 
observation helicopters to attack helicopters in the attack 
helicopter team. The decomposition of the experimental 


objectives is dipicted in Figure 6. 


203 





9 елпбта 


втечдооттеч 283328 оз 
злоздооттеч чотзелхэзао JO OTFEA :9J0N% 


S/Z €/T 2/0 с/с €/T х2/0 


+чЁбти Р Аер 


xiu лездооттеч 


$Ттел+ Tela = тела Ss [Tea 


110 uo JJO uo 


Аер и ти 


ә215 репЬѕ 


24 





First consider the relative importance of the two ob- 
jectives to the overall objective, i.e. accomplishing all 
experimental objectives. The planners may feel that the 
two are not equally important and will list them in order 
of importance, e.g., [01, 02], 01 being more important. The 
first step is to asSign to 0; a value of 1.0. Now consider 
02. The planner feels that it is only 2/3 as important as 
01 hence he assigns the number 2/3 to it. Next the assigned 
numbers are added giving 1.0 + 2/3 = 5/3. Each assigned 


number is divided by 5/3 giving 1+ 5/3 = 3/5 = .60 and 


ШІ; 5/3 = 2/5 = .40. Therefore 0; has a weight of .60 
and 02 has a weight of .40. The remaining weight assignments 
have been computed and are shown in Figure 7. The experimental 


objectives have been decomposed into components and weights 
have been assigned to them, completing the detailed component 


analysis. 


ЕН RELATIVE VALUE OF AN EXAMPLE EXPERIMENT 
The state of each of the lowest level components located 
at the tips of the "objective tree" can be described by a 


variable Be , where 


1 if component j is to be performed 


0 if component j is not to be performed 


Assume that an experiment, consisting of some of the Es 


, 
is proposed. For example, an experiment Eı could be the set 
of components [Xı, X3]. This experiment would consist of 


gathering data about optimum size of infantry squads at 
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night on.trails and during the day on Е Ета ООК 
components X; through Xıo (and hence both experimental ob- 
jectives) would be accomplished by the following set of 
experiments: 

Eı =[X1,X3] E2 =[X2, X4] Ez =[X5, Xs] Ea =[X6, X9] E5 = 
[Хэ, Х10] 

Now it is possible to determine the relative value of 
each of the proposed experiments. For each experiment 
assign a number to all = associated with the objective tree; 
2 = ] if the experiment will accomplish component j, = = 
ВЕ not. Multiply x times the weight of the component 
with which it is associated. Beginning with the lowest level, 
sum the products of component weight and X; for components 
which are sub-divisions of the same branch. Next, multiply 
this sum times the weight of the next higher branch. This 
glves a new tree, reduced in detail by one level. Continue 
until one number is obtained. 

For example, consider E2 and refer to Figure 7. Since 
X and Xs are to be done by this experiment, X; and X3 are 
assigned the value 1.0 and X2,Xu,X5,X6,/X7,/X8,X9,X10 are all 
assigned the value 0.0. Examine the "night" branch of 0. 
Since X, is zero (it is not done in this experiment) it has 
no value. Xı is 1.0 however, and contributes value. The 
Rust step then, as to multiply ¿20 by 1.0 ana .90 by 020€ 
Add these two values to get .20. Next multiply .2 by .6 
(che weight of thesnext higher branch) to ger 12. ТІП ЭШЕ 
same manner in the "day" branch .40 x .40 = .16. Thus the 


ШЕШСЕ БҮ апе contributes .l12 and the "day" branch TORTO 


2! 





а total of .28. There is no contribution From 07 Sor Cie 
relative value of the experiment is .28 times the weight of 
01 or .168. Evaluation of the remaining experiments gives 
relative values of 

Oy = .168 Co = .432 С: = .176 Cu = .104 Cs = .120 

These numbers indicate that experiment two (Е») would 
yield the greatest contribution toward the overall experimental 
objectives. Experiment five gives the least contribution. 

If only one of the experiments can be carried out, then 
experiment two would be the logical choice, assuming that 
the costs of the experiments ils not considered. 

This completes the discussion of relative value. It 
allows the value judgements of planners and decision makers 
КО Бе Stated explicitly. It is difficult to justify theo= 
Betically, but if it reflects accurately the decision maker's 
assessment of the importance of experiments it can be a 
useful tool. 

If the preceeding is acceptable to the decision maker, 
he can now discriminate between different experiments and 
can get a feeling for how an experiment will contribute to 
his over all goals. Suppose, however, that the resources 
necessary to complete all the experiments are not available. 
If this is the case, then only some of the experiments can 
be done. If there is only one resource to be considered, 
then experiments are chosen in descending order of the ratio 
of the relative value to the amount of the resource required. 


If there is more than one resource involved the problem 
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becomes much more complicated and must be approached by some 


form of linear programming. 


29 





ITL- A THET TMODEL 


The purpose of this section is to introduce a linear 
programming model of CDEC. The assumptions of the model 
will be stated, the model described, and illustrated by a 
continuation of the hypothetical example of section II. It 
will be assumed that the reader has a knowledge of the 


techniques of linear programming. 


AL OBJECTIVE FUNCTION 
In the model, experiments are represented by the variable 
EE The model assumes that the output of CDEC can be rep- 
resented as a linear function of the experiments to be 
F formed, іге., 
LE .СүїїРЭтС 2 207770: С.Е. 
The contributions of different experiments to the objective 
function are assumed to be independent of other experiments. 
Resources will be represented by b. where b; is the 
amount of the ith resource available. Resources are related 
to experiments by EL the amount of the ith resource required 
for the jth experiment. Now the model can be stated (for 
two experiments and two resources) as 
Мах 4 - 63891 т 02585 
о бе; А во 
ayo + 27282 
It is assumed that the amount of resource required by 


one experiment does not affect the amount required by another. 
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In this model Z will represent relative value as defined 
in the previous section. The coefficients C. will be the 
numbers derived to represent the contribution of each БЕ to 
accomplishment of all experimental objectives. Using the 
numbers from the previous example, the objective function 
for that five experiment case is 

7 = „168Е4 + .432E2 + .176Е; 4 .104Е, + .120Е. 

For reasons which will be discussed later, let 


Z = 10007 = 1698; (r 432E,ə; t 176E; ТОЛЕ 20а 


RRE SOURCE CONSTRAINTS 

For clarity of presentation, from this point on the model 
will be discussed in terms of the example in section 11. As- 
sume that the five experiments only require three resources; 
НАМ instrumentation, helicopters, and men, and let the 
amount of instrumentation available be b,; helicopters, 
Եշ: and men, b3. The model is now 

Мах Z - 168Е) + 432E + 176Е; + 104E, + 120E; 


Set, a E A в ՍԵԽԻ ՆԵՄ: SPS 


A 
Շր 


азо ЕО ИЗО Еа Е ЕБИ 


такта тыс т а на Бо CIS tM 


А 
өд 


To this point no restriction has been placed on Е ԼԵ 
will be assumed that an experiment will either be completely 
Mene or not done at all. This allows E. to have only zero 
er one for a value. 

The model will now be extended one step further by as- 


suming that resource availability is time dependent. This 


means that resource requirements and availabilities can vary 
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from time period to time period. For 5 штрїЇ л сал л EM 
time periods are assumed. The model now is as shown in 
Figure 8. The superscript k on ат, апа 2 indicates the 
time period. The model in Figure 8 is for two time periods, 
two experiments, and two resources. 

Resources for the example situation are shown in Figure 
9. Further information about specific experiments is in- 
cluded in this chart. Notice that not all experiments re- 
quire all four time periods. If, for example, an experiment 
requires only three time periods, it is possible to begin 
that experiment either in time period one or time period 
two. (It is assumed that experiments cannot be broken up, 
He. they must run on consecutive days.) This gives in 
effect two experiments, both of which must be considered 
when a maximum for Z is sought. For example, consider E; 
which requires no resources for one period and some resources 
the other three. BE can start either in period one or period 
two. It cannot start any later than period two since a later 
starting time would not allow the experiment to be completed. 
Е» must now be described by two variables, say Hı and H2, 
and since only one of this set is to be performed, the ad- 
ENtrTonal constraint that Hj + H = Oor l is added. This 
constraint says that either H, or H; but not poth can entes 
the linear program solution. This last constraint has the 
further advantage that it provides a schedule of the ex- 


periments which are selected. 
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Max Z = С, Еј + C; E; 


S.t. an 1 
ail 
а? 1 


eo 


Е } x а12 
Еу Та: 
Р t Сі 272 


Е: + а? 


Figure 8 
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Фа ILLUSTRATION 

The complete model will now be illustrated by the example 
data provided in Figure 9. The five experiments have been 
extended to fourteen by the reasoning just described. The 
problem is dipicted in Figure 10. 

1. Solution Procedure 

Solution of the example in Figure 10 is by an integer 

programming routine called ARRIBA. (See Appendix A). The 
program is not zero-one but by specifying that each variable 
be less than or equal to one a Zero-one program is obtained. 
A solution requires only that data consisting of the coef- 
ficients (C.) of the objective function (2) and the coef- 
meent matrix of - and b: be entered. Since the program 
is integer zero-one an objective function with fractional 
or decimal coefficients would give a trivial solution with 
all E equal zero. For this reason Z is transformed to get 
rid of the decimals in the original objective function. 

Solution 

The solution of the example in Figure 10 is given in 

Figure 11. “The detailed solution, shown in the computer 
output appendix, gave the following values for the fourteen 
variables: H:i = Н, = Н5 = Н; = Н; = Hg = Hg = Н)) = H13 = 
Hıy = 0 and H3 = Ha, + Но + Но = l. None of the variables 
which make up experiment three (Не, H7) were assigned a 
value of one, so that experiment was not performed at all. 
Experiment four, with a smaller contribution (relative value) 


than experiment three, was, however, chosen. 
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3. Comment 

The model can be described as a zero-one linear 
programming model which has as an objective the maximization 
of relative value. Relative value is arrived at by considera- 
tion of experimental objectives and a detailed component 
analysis. Resource availabilities and requirements by time 
period are assumed to be known. The solution of the linear 
program is in the form of an 270 schedule and is 
arrived at by a prepackaged computer program. 

An answer has now been offered to the question of 
how resources should be allocated to competing experiments. 
A model has been described and given substance by an example. 
Now questions arise about the form of the model and some 
examination must be made of how sensitive it is to changes 
in its form, specifically, how will it react to changes in 


the' coefficients of the objective function and the Б С 
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ТУ, SENSITIVITY ՐՈՐ ՆՈ: Սր 


This section will examine the effect of changes in the 
amount of available resources and coefficients of the ob- 
jective function. The effect of relaxing the assumption 
that experiments must be performed in consecutive time 
periods will be considered as will a solution arrived at by 
relaxing the requirement that the experiment be performed 


or not performed (zero-one assumption). 


Pee CHANGES IN THE OBJECTIVE FUNCTION 

In the example problem 0; was valued at .60 апа 0; ас 
.4. The value of the С. in the objective function depends 
neon the value of 0, and 0, and the С. change as they change. 
0; was allowed to vary from .1 to .9 and 0, varied accordingly. 
New values for S were computed for each of the nine values 
of 0, and 02. These values appear in Figure 12. The sched- 
ule corresponding to these values appear in Figure 13. For 
ша .1, 0շ Հ .9; 0; = .2, 02 = .8; 0; - .3, 02 = 27, the 
solution was schedule one in Figure 13. For the remainder 
the solution was schedule two in Figure 13. 

Varying the weights of the two experimental objectives 
gave a change in schedule. That change deleted experiment 
three from schedule one and added experiments one and four. 
Experiment two was unchanged, but experiment five was moved 
from period four to period one. 

The model was fairly insensitive to changes in the weight 
of 01 and 02 since there was only one change of schedule as 
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these values varied over the range which they were allowed 


to assume. 


B. RELAXATION OF RESOURCE CONSTRAINTS 

Consider the effects of relaxing each binding resource 
constraint for a solution. The value of the objective 
function (z) can change as can the solution schedule. In 
a normal linear program the increase in the objective function 
as binding constraints are relaxed can be used to imput a 
poe to resources. 

This concept cannot be used in integer programming. 
Consider again the solution to the example problem in which 
the value of the objective function for the solution is 824, 
and the binding constraint (slack is zero) is instrumentation 
in the third time period. When the number of men available 
in this period was changed from 110 to 300 the value of the 
objective function changed to 896 with the schedule shown 
in Figure 14. There were then three binding constraints, 
Be instrumentation in the fourth time period and men in 
Been the third and fourth periods. (See Figure 15). When 
these three constraints were relaxed, the new value of Z was 
896 with the same schedule. Further, there were no binding 
constraints. 

When the first constraint was relaxed, the objective 
function increased from 824 to 896 for an increase of ten 
units of instrumentation. This increase would not have 
Secured, however, for amy increase smaller than ten. ge 


took exactly ten units to get the increase, whereas in a 
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normal linear program some increase in Z would have been 
noted for an increase of one unit. In a normal linear 


program the imputed value of a unit of instrumentation would 


be 52/10 5.2. This implies that five units of instrument- 
ation would produce an increase of 26 in the objective 


function. This is clearly not the case for an integer 


program. 


=) NONCONSECUTIVE SCHEDULING 

It was previously assumed that experiments could not 
PemoLroken up, т.е. that once begun they must be кип ап! 
completed. An example similar to the initial example was 
solved under this assumption and then with the assumption 
relaxed. The example chosen has three experiments and three 
Աա ԱՐՏ and uses the same СМ, С, апа С. ої the initial 
example. The problems are stated in Figures 16 and 17. 
Note that the first problem (under the initial assumption) 
has seven variables whereas the second has fourteen. This 
need for more variables is a distinct disadvantage or 
relaxing the assumption. 

The advantage of relaxing the assumption is clear in 
the solution schedule in Figure 18 and in the value of the 
objective function. Under the assumption of consecutive 
scheduling only one experiment could be performed with a 
value for Z of 432. The other scheduling assumption al- 


lowed two experiments for a value of 600. 
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ра INTEGER PROGRAM 

If the five experiments in the example are considered 
to be iterations of ап experiment rather than a complete 
experiment, then the zero-one requirement of the program 
can be disregarded. The same objective function can be 
used but it can take on values greater than 1000, since now 
experiments can be scheduled more than once. The С. аге по 
longer relative value as it was earlier defined, but are 
viewed as an indication of the value of an iteration of an 
experiment. This SOR was applied to the initial 
example with all "less than or equal to one" constraints 
removed. The solution schedule is in Figure 19. It recom- 
mends that experiment one be done twice and that experiment 


five be done eight times, twice during each period. 


E. COMMENT 

It appeared that the model will provide different sched- 
ules for different values of the coefficients of the objective 
function allowing the planner and decision maker to reflect 
a change in his priorities. Changes in resource constraints 
also gave different schedules, but only for discrete jumps in 


the availability of resources. 
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V.. CONCLUSIONS 


The model gives a planner or decision maker an approach 
to the problem of how to allocate resources so that ex- 
perimental objectives are best met. The measure of ef- 
fectiveness of resource allocation is the degree to which 
experimental objectives are met. A detailed analysis of 
how proposed experiments can be done and a subjective eval- 
uation of the relative importance of the components which 
comprise the total experimental plan is required to derive 
this measure of effectiveness. The measure of effectiveness 
is transformed into a linear relationship of experiments and 
this linear relationship is then maximized subject to resource 
constraints. 

Resource constraints are given by time period as are 
experimental requirements. The linear program is then 
solved by an integer zero-one linear program algorithm pro- 


viding a solution in the form of an experimental schedule. 


РЕ CAPABILITIES OF THE MODEL 
T. Pilanning 
The model is a planning tool which can be used to 
predict gross over-commitments or under use of resource. 
Subjective feelings of planners about the importance of 
competing experiments are made explicit in the objective 
function, the coefficients of which can be readily varied 


as changes in priorities occur. Changes in the parameters 


Sul 


of the model (resource requirements and availabilities) can 
be made with little effort, allowing the planner to examine 
how changes in these parameters will effect the current 
опсео ел 
2. Resource Allocation 

The model establishes for the planner a link between 
the value of experiments and resources. The link may appear 
tenuous but can still give him an indication of the efficiency 


mens resource allocation. 


EZZZSHORTCOMINGS 
1. Subjective Evaluation 5 
The model allows the planner to make explicit sub- 
jective evaluations, but he must remember that the fact that 
the evaluations are stated does not make them more objective. 
For this reason care must be taken when decisions are to be 
made and final decisions regarding schedules should be based 
on a firmer basis than is provided by the model. The sched- 
ule Баьд by the model should be only one of the factors 
which the manager uses in arriving at a solution. 
ше Uncertainty 
The model does not consider uncertainty because it 
is beyond the scope of this paper. It is clear that the 
future avallability of resources and the future requirements 
for experiments are uncertain. A change in the structure of 
the experiment can change the requirements for that experiment 
and the reliability of equipment and availability of personnel 


can never be accurately predicted. It is assumed that the 
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planner will provide the model with the best information 
available and will update the model as new information be- 
comes avallable. 
3. Assumptions 

As previously noted, the model assumes that the 
worth contributed to the relative value of a proposed set 
of experiments by each separate experiment is independent 
of the other experiments. This allows the separate worths 
to be added. If this assumption is not true and hence the 
objective function and/or the constraints are not linear, 
a grossly inefficient allocation may be proposed by the 


model. 


БЕС ЕПЕТПЕК STUDY 
Uncertainty 
As was indicated earlier uncertainty in linear pro- 
gramming has been approached by the techniques of linear 
programming under uncertainty and chance constrained linear 
programming. Uncertainty could be introduced into this model 
by either of these techniques or by a PERT-type technique 
which would assume some beta distribution for resources. 
Past experience could be used to derive means and variances 
of available resources and the information projected into 
phe future. 
2. Other Solution Procedures 
Network algorithms which offer a more exact solution 
to the integer linear program are available. Ап alternate 


solution procedure could possibly be based on such a technique. 
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3. Validation 
The model should be applied to an actual resource 
allocation problem in an organization such as CDEC and the 
resulting schedules compared with schedules arrived at by 
normal procedure. This would require on the part of the 
planners involved an understanding of the concept of relative 
value. 
4. Worth of an Experiment 
It may be possible to apply the idea of relative 
value to a single experiment by considering different forms 
of the same experiment and examining how they contribute to 
the objective of the experiment in question. An indication 
of the value of a proposed change in the form of an experiment 
would be the change in the relative value of that experiment 


caused by the change in form. 


D. A PROPOSAL 

It is proposed that the model be considered for use in 
the planning of CDEC's experimentation. The model as de- 
scribed is greatly simplified but can be adapted for use at 
CDEC by increasing the number of resources and time periods 
to a useful level. Specifically, the model can be used in 
the Project Analysis stage of experimentation planning. 

Recall that the purpose of a Project Analysis was to 
develop a concept for experimentation that would best satisfy 
experimental objectives within available resources and time 
constraints. The first task of the Project Analysis group 


was to analyze experimental objectives to determine specific 
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tasks. This is also the first step required in the model; 
the detailed component analysis. The Project Analysis Group 
next considered the resources available and the experimental 
requirements. Finally the group proposed a schedule for 

the experiment under consideration. The model is designed to 
aid in all these tasks. Its use can provide a better under- 
standing of the structure of experiments and can aid in the 


efficient allocation of resources to experiments. 
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Written by: 


R.E. Woolsey, Candia Corp. and University 
of Texas 


Brady Holcolm, Union Carbide 
Peter Ryan, Stanford University 
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ARRIBA USERS MANUAL 


The ARRIBA system facilitates the solution of small integer 
programming problems by a variety of solution algorithns. 
Input is standard "SHARE! The system is written in a basic 
FORTRAN to facilitate conversion to various machines. The 
system is open ended in the sense that new solution algorithms 
are relatively easy to add. 


INN CONTROLS, CARD: 


The first card in any problem deck must be a CONTROLS, 
eared. If it is not found, the program will test for an EXIT 
Eurd. If an EXIT card is not found, the problem is terminated 
with ISTAT = 18, and the program searches forward until anoth- 
er CONTROLS card is encountered. The format of the card is 
seen below, CC. 1-80. CONTROLS, LIST = A,- OBJ VALUE ЕМЕКУ 772 
ST TUTTY LIST EVERYAAAAA, PTVOT LIMITAAAAAAAA 


Options: A. LIST = 1, prints input data on the standard 


ОМЕРЩЕ. 
LIST = 0, suppress printing of input data 
(ccu sc 
BE SEI VER EVERY NE cse SE air Mes 
objective function every xxxxth iteration 
(ЕС 91-540. 
CSR ACTIVITY LIST EVERY _ ‚ gives values of 


all variables every ххххх Iteration (со о о- 05). 


ОЕ ЛОМ? , sets pivot limit 


for the problems (CC.73-80). 


E. If the card is "CONTROLS," only, then the 
parameters are set to 0, 10, 1000, and 9999, 
respectively. 


Zee TITLE, CARD: 


The second card in a problem deck must be a TITLE, card. 
The user may put anything desired in the remaining 74 columns. 
The title card is always printed on the output listing. The 
first six characters of the title supplied by the user will 
appear on all output and will serve as the identifying refer- 
ence in batched jobs. “Error Message: If TITLE card is not 
encountered, problem terminates with ISTAT = 2. 
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Ej ROW ID CARD: 

The third card in a problem must be a ROW ID card, fol- 
lowed immediately by the ROW Identification cards in the 
following format: 


Card Column l-11: These columns must be blank. 


Card Column 12: This column is used to identify the 
type of constraint as follows: 


CC 12 = + Implies that the constraint is of the 
form <. 

СС 12 = - Implies that the constraint is of the 
form <. 

СС 12 = Implies that the constraint is of the 


form ==. 


Card Columns 13-18: This field is used as the name of the 
row in six alphanumeric characters. 


Note: The first row is always the name of the objective 
function row; and for this row the only types allowed in 
card column 12 are + (minimize) or - (maximize). 


Error Message: If ROW ID card is not found, problem 
terminates with ISTAT 3. If row name appears twice, problem 
terminates with ISTAT 4. 


OT EOR CARD: 


The card terminating the definition of rows must be an 
POR. Error Message: If an EOR is not found, problem ter- 
minates with ISTAT = 4. 


Տա. MATRIX CARD: 
The MATRIX card signals that the body of the matrix fol- 
lows. It is followed immediately by the matrix entry cards 


ШІ пе following format: 


се: 1-6 Blank 


Cee 7-12 Column identification of six alphanumeric 
characters. 

СС. 12 Rov identification of Sika alphanumerie 
characters. 





СС. 19-30 Value of matrix coefficient read in with 
F12.6 specification. 


Note: Тһе first column réad in must be the ricbe шее 
of the problem. All other columns are read in from left to 
right across the matrix. In the columns the non-zero entries 
are read from the top down (see examples). 


Error Message. If a MATRIX card is not found, problem ter- 
minates with ISTAT = 5. If matrix entry is out of sequence, 
problem terminates with ISTAT = 6. 


6. EOR CARD: 


The card terminating the matrix entries must be an EOR. 
Error Messate: If an EOR not found, problem terminates with 
ВРАТ = 6. 


Ше BASIS CARD: 


The BASIS Card may appear after the matrix EOR and signals 
that some starting solution values are to be imposed on the 
solution. This card is followed immediately by the BASIS 
entry cards in the following format: 


2 #6 Blank 
СС. 7-12 Six-character alphanumeric column name. 


CC. 19-30 Value of the variable read in with F12.6 
specification. 


If an imposed basis is used, the last BASIS entry card 
must be followed by an EOR card (see below). 


WARNING: “This option must be used with great care; for 
when a basis is proposed such as x, = 5.0, this by implication 
Pads to the original problem the constraint x, 2 5.0. Thus 
ТЕ the algorithm converges to an optimum solution, ШЕ is an 
optimum of the augmented (imposed basis) problem and not 
necessarily an optimum of the original. 


Error Message: If BASTS Cara not found, no error message 
will appear; the program will assume that the card is ап 
algorithm card and proceed accordingly. 


9: БОК САҚБ: 


This card is necessary only if a preceding BASIS card 
is used. 
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Error Message: If EOR card not found, problem terminates 
with ISTAT = 8. 


2 ALGORITHM CARD: 


This card identifies the algorithm desired for application 
to the foregoing problem. The present algorithms in the 
ARRIBA system are as follows: 


CC. 1-4 IPSC - A Gomory cutting plane code with a row- 
ordering pivot choice rule. 


CC. 1-6 PRIMAL - A primal cutting plane code based on 
the algorithm of Harris: 


СС. 1-6BALASG - A version of the original Balas zero- 
one algorithm with the changes suggested 
by Glover. 


Error Messages: If an ALGORITHM card is not found, the 
program terminated the problem and prints "AGENDUM CARD RE- 
QUESTS INTEGER ALGORITHM NOT PRESENTLY IN ARRIBA." 


CC. 78-80 Upper bound on solution (IUPBND) used with IPSC 
and PRIMAL. 


рс we define the matrix under consideration tOo be orne 
Torm: 


If the matrix is not lexicographically dual feasible 
(1.e., there exists at least one non-positive first non- 
zero column element), ARRIBA transforms the matrix into 
usable form by defining the variable. 


Z = IUPBND + 2 222) 
је5 


where s 1s the set of negative columns and IUPBND is an upper 
bound on the sum of the variables in s. We now replace J^: 
eae smallest column іп =. бу ере substitcution; 


x. = IPUBND + X  (-x,)-Z. 
Ji jes 


ի 
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In this manner, the problem is brought into dual feasible 
Orm: 


It should be noted that IUPBND is selected as very large, 
the problem may run an excessive number of iterations. How- 
ever, if IUPBND is selected smaller than X (-x.) at the 

jes 
optimal solution, the optimal solution will never be reached. 
Some analysis of the problem is, therefore, necessary to 
avoid either of the two situations above. 


10. ARRIBA CARD: 
This card signals the program to begin computation. 
Error Message: If an ARRIBA card is not found, the 
problem terminates with “ISTAT = 12. 


WET EXIT CARD: 


This card signals the end of all jobs and exite the 
program. 


Error Message: If an EXIT card is not found, the problem 
terminates with ISTAT = 18. 
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